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Abstract 

The computation of divergence is greatly simplified when the covariance 
matrices to be analyzed admit a common diagonalization, or even triangulation; 
that is, when there exists an invertible matrix P such, that, for each co- 
variance matrix A under consideration, PAP -1 is diagonal, or triangular. 

In this report, sufficient conditions are given for such phenomena to 
take place; the arguments cover both real and complex matrices, and are not 
restricted to Hermitian or other special forms. Specifically, it is shown to 
be sufficient that the matrices in question commute in order to admit a common 
triangulation. Several results hold in the case that the matrices in question 
form a closed and bounded set, rather than only in the finite case. 



COMMUTATIVE SEMIGROUPS OF REAL AND COMPLEX MATRICES ' 

BY 

D.R. Brown 

Commutative matrices have boon examined in detail J an excellent 
bibliography of pertinent papers is given in [■? In this 
chapter , using the Jordan form of a matrix and a theorem of 

Kaplan sky, it is first shown that any commutative semigroup of 
nX n complex matrices is similar to a semigroup of lower 
triangular matrices (matrices which are zero above the main diagonal). 
Following this, commutative semigroups of real matrices are studied. 
For a proof of the first theorem, see [ 1J. 

1 ) , Theorem (Kaplansky) . Let S be a multiplicative semigroup of 
nxn matrices over a division ring, consisting of nilpotent 
elements. Then S is similar to a semigroup of strictly lower 
triangular matrices (matrices which are zero on and above the main 
diagonal) • 

2) . Lemma . Let A be an nxn complex matrix in Jordan form, 

A = diag{A^ 1 , ..*• A^}, - }\^ + , with each ^ ^ a scalar 

and each a lower triangular nilpotent having ones and zeros 

on the first principal subdiagonal and zeros elsewhere, and 
Ai ^ ^ i 5^ j . Let B = (B^) be an nxn complex matrix 

decomposed in the same dimensions as A. If AB * BA , then 

B ij = °» 1 * i ; that is * B is in super - diagonal form ' 

B = diag{B^ 1 , ... , B^} . 
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Proof: Fix i = p, j = q . Sine© AB = BA. , it follows that 

+NB = X B + B N , whence (A - A = B N 

Ak pq pp pq A q pq pq qq * A p A q pq pq qq 

- ^pp^pq • kot i = 1, • • * , r , 3 ~ 1» • ••» s , and 

let N pp « ( n ij)> N qq = By the prior equality, 

<*1 - X£\j m *lj+lVU ’ 3 * S " and ( ^1 * ^ s )b ls = 0 • Sinoe 
^1 A a » = Q * and honco b 0, j = 1, s . Assume 

the first k - 1 rows of B have been proved identically aero. Then 
(A k - Aj)\ s = 0 » from which it follows that b^ * 0,j = 1, a * 
Therefore B = 0 . 

pq 


3)^ Theorem . If S is a commutative semigroup of nxn complex 
matrices, then S is similar to a semigroup of lower triangular 
matrices. 


Proof: The theorem is proved by induction on the order of the matrices 

composing S . If n = 1, there is nothing to prove* Suppose the 

i 

theorem has been proved for semigroups with matrices of order k < n , 

and let S be a commutative semigroup of nxn complex matrices* 

If there exists A e S such that A has j > 1 distinct 

eigenvalues, then by 2) S can be decomposed into super diagonal 

form, S = diag{S^, S^}* Each is a commutative semigroup 

of order less than n , hence is similar to a semigroup of lower 

triangular matrices. Since the semigroups S ,S , p f q, are 

p q 

independent of one another, it follows that S is similar to & 
semigroup of lower triangular matrices* 
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It remains to dispose of the case in which each A e S has a unique 
eigenvalue. By referring to the Jordan form of A , it can be seen 
that each A e S decomposes into the sum of a scalar (the 
eigenvalue of A ) and a nilpotent; A = A+ N . Let 

= (N « for soma A e S, ^ e S(A), A = A + M>. If m,H e 'ft , 
then MN = NM; for, let A = + N, B = 0< + M. Then 

A M + « N + NM = AB = BA = «A + Am + CX N + MN, hence 
MN = NM. Let be the semigroup generated by • Since 

elements of 7l commute, consists of nilpotent elements. Hence, 
by. 1), there exists P such that PftV 1 , and therefore 
P??P , is in strictly lower triangular form. Finally, if 

A ~ A + N c $, then PAP = \ + PNP* 1 , which is lower triangular. 
Hence PSP is lower triangular. 

4>:,’ Cor ollar y . Let S be as in . 3). if there is an A c S 
having n distinct eigenvalues, then S is similar to a semigroup 
of diagonal matrices. If, furthermore, the matrices in S are real * 

and A has a real spectrum, then S is similar to a semigroup of 
real diagonal matrices. 

Proof: The Jordan form of A i 3 diagonal; by 2) it follows that 

S can be diagonalized. The latter part of the corollary follows 
from the fact that the Jordan form of A is real . 

Note that a semigroup of n*n diagonal matrices is iseomorphio to 
a subsemigroup of the Cartesian product of n copies of the scalar 
field under coordinate multiplication. Sufficient conditions, 
different from those in 4 ) for a semigroup of complex (real) 
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matrices to bo similar to a diagonal semigroup are now investigated. 

5). Lemma . Lot {E^}, i — 1, . k bo nx n complex (real) 
idempotents suah that E^E^ = E^E^ = E^, i < j , rank E i =» r(i) . 

Then there exists a complex (real) matrix P such that 



ProofI _ Note if i < j , then r(i) < r(^)* The lemma is proved 

by induction on n . If n = 1, there is nothing to prove. Assume 

the lemma has been proved for matrices of order less than n • As 

remarked above, E^ is the idompotent of maximal rank r(k) in 

the set {E^}. Hence there exists a complex (real) matrix P 

.-1 


such that 


PE k p ' 


X r(k) 0 


• Since E, is an identity 

A» 


for E^ , i s lp . • * p k, it follows that PE^P ^ — / 0 \ , where 

1 ° 0 I 

^i is SOme r(k) X r(k) submatrix. If r(k) < n , then the system 

-1 

PE^P is isomorphic to a system of dimension less than n , and 
the lemma is proved, otherwise, = I , in which case the above 
argument is applied to . Since r(k - 1) < n , the inductive 

hypothesis can be applied to the system {E^, i = 1, .. #f k - 1 , to 
complete the proof of the lemma. 

6). Corollary. Lot S be a commutative semigroup of complex (real) 
n k n matrices with zero , rank E^ = s ; identity E^ , 
rank = s + k - 1 . Suppose, also, that S contains a system of 
k idempotents {E^} as in 6) between E^ and with 
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rank E. = s + i - 1 . Then S is isomorphic to a diagonal 
1 

semigroup of (k - l)X(k - 1) complox (real) matrices. 


Proof: Lot f bo tho function defined by f(X) = X - , X « S . 

It is clear that f is an isoomorphism of S into tho n*n 
matrices such that rank f(E^) = i - 1 . Lot P bo the matrix of 5) 

such that Pf(E i )P' 1 = / o\ . Now Pf(S)P _1 has 

lO 0 


identity 



Honce if X c S , then Pf(X)P“ 1 


X* 0 
0 0 


whore X* is a (k - l)x(k - 1) submatrix. Since X must commute 

t 

with 1^, i = 1, . .., k , it follows by direct computation that X 
must be diagonal. The details are omitted. The function f and the 
similarity generated by P are clearly continuous. 


Note that, if S satisfies the hypotheses of 6) and is, in addition, 
compact, then the diagonal entries of 5 are bounded above in 
modulus by 1 . Hence, in the complex case, S is a subsemigroup of 
the Cartesian* product of unit discs; in the real case, S is a 
subsernigroup of the Cartesian product of real interval 9 £-1,1 ]• If 
S has stochastic entries, the full interval [-1, 1] may still be 


realized, as is shown by the 2X 2 example 


x 1 - x 


,x c £0,1^* 


V 1 - , x *7 

7). Corollary . If S is a semigroup of nxn real matrices, and 
if S has a zero E and an identity F whose ranks differ by one, 
then S is iseomorphic to a subsernigroup of the real numbers, and 
hence commutative. If S is also connoc ted, then S contains the 



con vox arc bo two on E and F 


Proof: In tho argument establishing . 6 ') the commutativity is not 

needed when there aro los3 than 3 idompotents In tho chain. Hence S 
is iseomorphic to a semigroup of 1X1 roal matrices, which aro 
essentially tho roal numbers. If S is connected, then the 
iseomorphic copy of S must contain tho arc between (1) and (0). 
Sinco the function f and tho similarity generated by P of 6> 
are affine mappings, S must contain the convex arc from E to F • 

If the ranks of E and F differ by more than one, then S need 
not even be diagonal. Indeed, the mapping 


f{x) = / x o 
^(-lnx)x x / 


, x c (0,1], f(0) = 



is an 


iseomorphic imbedding of the unit interval demonstrating this fact* 
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